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Claim 

1. In a system for creating a computerised image made up of object", a 
method of scanline rasterization of self-overlapping objects, said method comprising, 
for each of said self-overlapping objects, the steps of: 

determining a directional border of said self-overlapping object; 

determining intersections of said directional border with a current scanline of 
said image; 

determining, for each pixel within said scanline, a count of the number of 
preceding intersections, wherein said count is incremented for directional border 
crossings in a first direction and is decremented for said directional border crossings in 
a second direction; and 

rendering each pixel of said seif-overlapping object a number of times equal to 
said count. 

6. A method of compositing objects in an image, said method comprising 
the steps of: 

converting an outline of each of said objects, wherein said outline includes of 
two or more splines, to produce a border, wherein said border includes a plurality of 
edges; 

defining a directional border for each of said objects, wherein a direction is 
stored for each edge of said plurality of edges; and 

rendering said image wherein the following steps are performed for each pixel 
of a scanline: • - -/2 
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incrementing a count if a pixel is an edge having a first direction, or 
decrementing said count if said pixel is an edge having a second direction; and 

rendering colour information of said pixel in reponse to an absolute value of 
said count. 

7. In a system for creating a computerised image made up of objects, an 
apparatus for scanline rasterization of self-overlapping objects, said apparatus 
comprising: 

means for determining a directional border of said self-overlapping object; 

means for determining intersections of said directional border with a current 
scan line, wherein said directional border is received from said means for determining a 
directional border; 

means for determining, for each pixel within said scan line, a count of the 
number of preceding intersections, wherein said count is incremented for directional 
border crossings in a first direction and is decremented for said directional border 
crossings in a second direction; and 

means for rendering each pixel of said self-overlapping object a number of 
times equal to said count. 
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The following statement is a full description of this invention, 
including the best method of performing it known to me/us:- 



Rendering of Overlapping Objects 

Field of the Invention 

The present invention relates to the composition of computer graphic images 
and, in particular, the composition of objects that exhibit overlapping or "two and one 
half dimensional" aspects. 
Background Art 

Techniques of compositing objects, which include transparency, to create a 
final image are well-known in the art. In a first conventional method, which derives 
from the "painter's algorithm", each object is normally "rendered" to create a 
corresponding pixel representation. The pixel representation is normally utilised in 
building up a final image of the objects through combining it with the representation of 
other objects. In order to implement transparency, a separate "alpha" channel value is 
often stored for each pixel of the object, indicating the object's degree of transparency. 
For a detailed description of combining objects having degrees of transparency, see 
pages 253 to 259 of an article entitled "Compositing Digital Images", SIGGRAPH 84, 
written by Porter and Duff, incorporated herein by reference. 

An object 1 is shown in Fig. 1 that is to be rendered on top of the object 2 on a 
computer graphics image processing system. The object 1 is defined to be of a first 
colour and is partially transparent in that, after rendering, the object 2 is partially 
visible through the object 1. The border, or outline, of both objects I and 2 is defined 
in terms of splines in accordance with conventional techniques for defining such objects 
in the art. 

The creation of the image of Fig. 1 using the conventional alpha channel 
method will now be described with reference to Figs. 2 to 4. In Fig. 2, the currently 
created image consists of the previously rendered object 2. The object 2 is different 
from the object 2 of Fig. 1 in that it has been "scan converted", or rendered, to consist 
of an array of pixels rather than the format of Fig. 1 which consists of a spline outline 
and a representation of the internal colour of the object 2. In order to composite the 
object 1 shown in Fig. 3 onto the current state of the image (as defined by Fig. 2) to 
form the desired image shown in Fig. 4, which includes both of the objects 1 and 2, it 
is necessary to notionally render the object 1 into a corresponding pixel representation, 
with each pixel including colour and transparency information, in accordance with the 
Porter and Duff model, so that the corresponding pixel image of Fig. 3 can be 
combined with that of Fig. 2 to form the final image as shown in Fig. 4. 

In order to render objects 1 or 2, which, as noted previously, are defined by a 
spline outline, it is normally necessary to convert the spline outlines to an 
approximation to the spline outline which consists of line segments richer than splines. 
This process of conversion is commonly known as "vectorisation". The process of 



vcctorisation is well known to those skilled in the art. For example, two methods are 
described in detail at pages 487 to 488 and 511 to 514 of Computer Graphics: 
Principles and Practice , written by Foley et al., and published in 1990 by Addison- 
Wesley Publishing Company, incorporated herein by reference. 

Referring now to Fig. 5 there is shown the result of vectorisation of the object 
1 into a corresponding polygon having five sides 6 consisting of straight line segments 
(6A to 6E). The outline of object 1 is such that it "doubles back" on itself and the 
object 1 overlaps itself so that two portions of the object 1 are present in the 
overlapping portion 5. 

If the object 1 is partially transparent, it is desirable to exhibit a 'two and one 
half dimensional effect within the portion 5 so that the overlapping becomes more 
evident to the observer of the final image to be created. However, the foregoing 
conventional scan line methods are not be able to achieve this effect. They are 
disadvantageous^ unable to determine if a current object is overlapping or not. 
Summary of the Invention 

It is an object of the present invention to provide an efficient method of 
rendering self overlapping objects. 

In accordance with one aspect of the present invention, in a system for creating 
a computerised image made up of objects, there is provided a method of scanline 
rasterization of self-overlapping objects, said method comprising, Tor each of said self- 
overlapping objects, the steps of: 

determining a directional border of said self-overlapping object; 

determining intersections of said directional border with a current scanline of 
said image: 

determining, for each pixel within said scanline, a count of the number of 
preceding intersections, wherein said count is incremented for directional border 
crossings in a first direction and is decremented for said directional border crossings in 
a second direction; and 

rendering each pixel of said self-overlapping object a number of times equal to 
said count, the steps of: 

determining a directional border of said self-overlapping object; 

determining the intersections of said directional border with a current scan 

line; 

determining, for each pixel within a scan line a count of the number of 
preceding intersections wherein said count is incremented for directional border 
crossings in a first direction and said count is decremented for directional border 
crossinas in a second direction; and 



rendering each pixel of said self-overlapping object a number of times equal to 
aid count. 



Fig. 5 illustrates the process of vectorisation and scan line rendering according 
to the preferred embodiment; .' ■ " ' ... .: ■ ■■ ■ .. ;/ : ' M-l^M^ 

: ■ ; Fig 6 illustrates the process of rendering a single scan line according to the 
preferred ernbodiment;^^^/;i^^ , :C; ; v 

•/t; f ; Fig 7 is a flow diagram illustrating a method according to a - ft^er 
embodiment of die invention; 




In the preferred embodiment, a direction of each side. 6 x>f the yectpnsation is; v . 
■ ■ v » ^ o^rmined^ Thb direction is determined bystarting at one ; smV£ a^|aoving .around I ^ 




' 5 the normal! manrer^iA a^ntionai processor" scan cbnyersio^as^t out in detaU^in j|g - : 
chapter 3 of Foley et al; keeps a runnmg edge list of those i^ges ^ intersect a current g 
! "scan iine" 7 (see, m particular, pages 97-99 of Foley). In the pr^nt emo^ 
20 edge table and active edge list are modified to also store^e!dire«ion of each edge ^ ; 

#££(beinVe^ 

r>.r \Ck n^n, /lUrmm nf thA nrinrMc nf th* m*»thnH of Healing with self overlaDDine r: : 




'^'"iln^ with me associated transparency ; 

'35 y> u^onnation a numbw of : tiines equal tb.me'coimt ; V'l^ W-C*"-fS 
7i^^^0r^''mlSo^^i:m be described with referenc* to Fig. 6. There is shown 
me object 1 in phantom, with the edges intersecting the current scan line 7 of Fig. 5 
shown with arrows indicating their direction. When rendering each pixel of a scan line 
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7, a count is kept of each edge 8 to 10 crossed. When an edge 8 and 9 in the up 
direction is encountered, the count is incremented. When an edge 10 and 11 in the 
down direction is encountered, the count is decremented. Each pixel of an object on 
the scan line 7 is rendered a number of times indicated by the absolute value of the 
5 current value of the count. 

For the portion of the line to the edge 8 in Fig. 6, the count is zero (0)and the 
object 1 does not form part of these pixels. Upon encountering the "up" edge 8, the 
count is incremented to one (1) and the object colour, with its associated transparency, 
can be rendered once in accordance with a conventional technique such as the Porter 
10 and Duff method. Upon encountering the "up" edge 9 the count is again incremented 
(2) and the object colour is rendered twice in accordance with the conventional Porter 
and Duff method. The "down" edge 10 is in the opposite direction and results in a 
decrementing of the count (1), with the object being rendered once from edge 10 to the 
"down" edge 11, where another edge is encountered in the opposite direction and the 
15 count is decremented to zero (0) where it stays for the rest of the scan line. 

Rendering can then proceed to the next scan line in the conventional manner, 
until the image rendering is completed. By utilising the absolute value of the 
directional edge count in determining the number of times to render object 1 , the initial 
direction chosen to enumerate the direction of the edges 8 to 10 of a vector isation of a 
20 spline is not of concern. 

The process according to the preferred embodiment of the invention can be 
practiced as a computer- implemented method using a personal computer 806 shown in 
Fig. 8, for example. As is well known in the art, such a computer 806 typically 
comprises a central processing unit 810 coupled to a memory device for storing data 
25 and instructions to operate the central processing unit. For example, personal 
computers commonly include random access memory (RAM) for temporarily storing 
data and instructions, as well as secondary storage devices (e.g., hard drives and floppy 
discs) for storing data and instructions either temporarily or permanently. 

As shown in Fig. 8, the processing unit 810 is coupled to a bus 822, which is 
30 well known in the art. Such a bus typically includes an address bus, data bus, control 
signals, and the like. In turn, random access memory 812, read only memory 814, 
hard disk drive/floppy disk drive 816, video interface 818, and I/O interface 820 are 
coupled to the bus 822. The video interface 818 provides output to display/monitor 
800. Likewise, I/O interface 820 is connected to reproduction device 802. 
35 Reproduction device 802 may include laser beam printers, plotters, dot matrix printers, 
and the like. Accordingly, an apparatus for dealing with self-ov flapping objects in a 
system for creating computerised images, which are made up of objects by means of a 
scan line process can be implemented using such a personal computer. 
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An apparatus 920 for compositing objects in an image is illustrated in Fig. 9. 
The apparatus 920 receives input 902 consisting of one or more objects. The apparatus 
920 creates the computerised images made up of objects using a scan line process. The 
input 902 is provided to directional border determination means 904 for determining a 

5 directional border of an object. The output of directional border determination means 
904 is provided for intersection determination means 906 for determining intersections 
of the directional object with a current scan line. The directional border U received 
from the directional border determination means. The output of intersection 
determination means 906 is provided to intersection count means 908. Intersection 

io count means 908 determines, for each pixel within a scan line, a count of the number of 
preceding intersections, in which the count is incremented for directional border 
crossings in a first direction and is decremented for a directional border crossing in a 
second direction. For example, the count can be incremented for an "up" crossing and 
can be decremented for a "down" crossing. The output of intersection count means 908 

15 is provided to pixel rendering means 910. The pixel rendering means renders each 
pixel of the object a number of times equal to the count. This is done for each pixel of 
the scan line and for all of the scan lines of an image. The output image 912 is 
provided at the output of pixel rendering means 910. 

Further, the rendered image produced by the process and/or apparatus 

20 according to the embodiments of the invention can be provided as output to video 
terminal displays (or monitors) 800, reproduction devices including laser beam printers, 
plotters and dot matrix printers, and the like. While a number of reproduction devices 
have been discussed, it will be apparent to a person skilled in the art that other 
reproduction devices can be used without departing from the scope of the invention. 

2$ The forgoing describes only embodiments of the present invention, 

modifications, obvious to those skilled in the art can be made thereto without departing 
from the scope of the invention. For example, those skilled in the art would understand 
that the above system could render multiple objects simultaneously. 



The claims denning the invention are as follows: 

1. In a system for creating a computerised image made up of objects, a 
method of scanline rasterization of self-overlapping objects, said method comprising, 
for each of said self-overlapping objects, the steps of: 

determining a directional border of said self-overlapping object; 
determining intersections of said directional border with a current scanline of 
said image; 

determining, for each pixel within said scanline, a count of the number of 
preceding intersections, wherein said count is incremented for directional border 
crossings in a first direction and is decremented for said directional border crossings in 
a second direction; and 

rendering each pixel of said self-overlapping object a number of times equal to 

said count. 

2. The method according to claim 1 wherein said self-overlapping object 
is partially transparent and has associated transparency and colour information. 

3. The method according to claim 2 wherein said rendering step 
comprises rendering said colour information in accordance with said associated 
transparency information said number of times equal to said count. 

4. The method according, to any one of claims 1 to 3 wherein said 
number of times is equal to an absolute value of said count. 

5. The method according to any one of claims 1 to 4 further comprising 
the step of storing in an edge table a direction for each of a plurality of edges defining 
said directional border. 

6. A method of compositing objects in an image, said method comprising 
the steps of: 

converting an outline of each of said objects, wherein said outline includes of 
two or more splines, to produce a border, wherein said border includes a plurality of 
edges; 

defining a directional border for each of said objects, wherein a direction is 
stored for each edge of said plurality of edges; and 

rendering said image wherein the following steps are performed for each pixel 
of a scanline: 
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incrementing a count if a pixel is an edge having a first direction, or 
decrementing said count if said pixel is an edge having a second direction; and 

rendering colour information of said pixel in reponse to an absolute value of 
said count. 

7. In a system for creating a computerised image made up of objects, an 
apparatus for scanline rasterization of self-overlapping objects, said apparatus 
comprising: 

means for determining a directional border of said self-overlapping object; 

means for determining intersections of said directional border with a current 
scan line, wherein said directional border is received from said means for determining a 
directional border; 

means for determining, for each pixel within said scan line, a count of the 
number of preceding intersections, wherein said count is incremented for directional 
border crossings in a first direction and is decremented for said directional border 
crossings in a second direction; and 

means for rendering each pixel of said self-overlapping object a number of 
times equal to said count. 

8. A method of rendering self-overlapping objects using a scanline 
process in a system for creating computerized images having at least one object, said 
method comprising, for each of said objects, the steps of: 

determining a directional border of said object; 

determining intersections of said directional border with a current scanline; 
determining a count for each pixel within said scanline, based on the direction 

of said directional border on the determined intersections, wherein if said pixel is: 
a part of an image outside said object, said pixel has a first count, 
a part of said image within said object, said pixel has a second count, and 
a part of said image within a self-overiapping portion of said object, said pixel 

has a third count; and 

rendering each pixel of said object on the basis of said count determined for 

each pixel. 

9. An apparatus for rendering self-overlapping objects using a scanline 
process in a system for creating computerized images having at least one object, said 
apparatus comprising: 

means for determining a directional border of said object; 



<Openl3X31 I074XCFP0363) 



|O:.OPHN\0Pi:M31SPHni.VIAD 



means for determining intersections of said directional border with a current 
scanline; 

means for determining a count for each pixel within said scanh *e, based on the 
direction of said directional border on the determined intersections, wherein if said 
pixel is: 

a part of an image outside said object, said pixel has a first count, 
• I a part of said image within said object, said pixel has a second count, and 
a part of said image within a self-overlapping portion of said object, said pixel 
has a third count; and 

means for rendering each pixel of said object on the basis of said count 

determined for each pixel. 

10! In a system for creating a computerised image made up of objects, a 
method of scanline rasterization of self-overlapping objects substantially as herein 
described with reference to any one of the embodiments as illustrated in the 
accompanying drawings. 

11. In a system for creating a computerised image made up of objects, an 
apparatus for scanline rasterization of self-overlapping objects substantially as herein 
described with reference to any one of embodiments as illustrated in the accompanying 
drawings. 

DATED this Ninth Day of June 1998 
Canon Information Systems Research Australia Pty Ltd 
' ' ' V CanonM ' 

' . '-'Patent Attorneys for the Applicants 
: J. ; SPRUSON & FERGUSON 
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Rendering of Overlapping Objects 

ABSZBA£E ^ ^ ;>4 v vV 

A method of dealing with self-overlapping objects in a system for creating %:'-X-: 
computerised images, which are made up of objects, by means of a scan line process is v ; 
described. For each of the overlapping objects (1,2), a number of steps are performed. 
A first step (702) is to determine a directional border of the object (1). Another step% ^| : 
(704) involves determining intersections t of the directional border (8 to 10) with a i?f jl|§§|f : : 
current scan .livfft ^further step is to (ietennine/ for each pixel wi^ line 
(7), a count of u^mimber of preceding totereections/ whereto is incremented r 



ing in a first direction and todecra^ r-W 

i In a WnnH Mrmrtttsn Still i fhrrlW etm ftfVft 'ta^f^: • /■> v -<3rf 



fcasec^^ 

to render each pixel of the object (1) a numt>er of times equal to the count : ^^0^MSt- 
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